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ABSTRACT 

In 1972, the board of regents of the 
system of Georgia directed that a testing program be established to 
provide information on the status of student -competence in the areas 
of reading and writing. In addition, the program was to provide a 
uniform means of identifying those students who fail to s.ttain..., 
minimum levels of coicpetence expected of graduates in these areas. 
This paper describes the instrument and the grading; procedure; 
reviews the related literature; examines the relationship between 
student background characteristics, college variables, and 
performance on the examination;- explores predictability of student 
performance; and presents the implications for higher education. A - 
list of references and tables of findings are included. (JM) 
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SYSTEM-V7IDE LANGUAGE SKILLS EXAMINATION: 
A LOOK AT THE UNDERLYING FACTORS 

James E. Prather and Olynton Smith, Georgia State University 

The trend toward universal availability of higher education has increased 
public focur. upon the question of the basic competency in English language skills 
of contemporary college students. Higher education systems in California, Michi- 
fien, Morth Carolina, and Illinois are reported to be undertaking assessment of 
the l8tir;uof7;e skills of their students. 

?he University System of Georgia in 1972 developed an evaluation procedure 
^.o assess the success of academic programs and to provide the needed information 
for decision-making about program development and improvement. The lack of an 
adequate and suitable testing instrument resulted in the development of a 
measurement instrument for the University System. A Board of Regents^ policy 
adopted in 1072 decreed that this examination be instituted. It is a goal 
of the Regents "that students obtaining a degree. . .possess the basic competence 
of academic literacy, that is, certain minimum skills of reading and writin;:" 
(p. I7UB). The objectives of the Regents' Testing Program are: 

1. To provide System-wide infomation on the status of 

student competence in the areas of reading and writing; 
and 

To provide a uniform means of identifying those students who 
fail to attain minimum levels of competence expected of 
graduates in the areas of reading or writing, (p. 17^B) 
Since the establishment of the program 75,735 examinations have been admin- 
istered as of Spring, 1975, to students in the University System of Georgia 
v/hJch is eompriL'ed of 32 institutions ranging from small junior colleges to 
large universities. 
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This paper describes the instrument end grading procedure, reviews the 
related literature, examines the relationship between the student background 
choniCJ-eristics, college • variables and performance on the examination, explores 
Dred: C'. e'Dxii t;/ of student performance, and presents the implications for higher 
education. 

Regents' Test and Grading Procedure 

Officially, the ^Regents' Test is administered to all students during the 
first quarter of enrollment after they have received ^5 credit hours. The test 
is divided into two parts --reading and essay. The reading part consists of a 
vocabulary portion v/hi ch tests word usage and a reading comprehension portion. 
The essay part requires a student to vnrite an essay on one of two topics given, 
i'^oth parts of the test must be passed at the same administration. - 

The readirifr, section of the test is scored based on the n(. -mative data 
from the orir^inal group bested. To pass, students must score higher than the 
tenth percentile. Teachers of English in the University System of Georgia 
score the essay on a criterion basis following a holistic procedure. Raters 
judge trie ec:£oy on predetermined criteria of va-iting ability: (1) crgani- 
zf-ition 'limiting the r-ubject; evidence of a thesis; ^^nd unity, logical development, 
coherer.ce, and evidence of the development of the the:^^:- ' ; (2; rhetoric (diction, 
sente)ice tructure;, and point of view); and (3) mechanics (spelling, punctuation, 
and usage).' The rating scheme is a four-point scale indicating essay quality: 
1 (substandard); 2 (v/eakh 3 (good); and k (superior). Both the identity of 
t.he student and his institution -are unknown to the rater. Each essay is scored 
independently by three faculty members. A score of "1'' or "not acceptable" 
must have been assigned to the e:ssay by at least two of the three raters. 
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H eyl ey^Qf ^ I^g,!^ t L j t e r at ure_ 

The so-called "deprived .student" or the low achieving student has been 
vrldely studied in recent yea^^s/ The problem of low achievers in an "open door" 
colle^-ie environment was explored by ^^oueche aac3 Hui^lburt (I968), Holstrom (1973), 
end :':choenfeIdt et al. (1970). The rise of community junior colleges in Georgia 
has tended to accelerate the n^her of tr^nsfei* students. The Committee on 
Transfer of Credit (19^9' of the U:iiversity System of Georgia dealt with trans- 
fer problems and developed a "core curriculum" to facilitate transfers. It 
cKould be noted that Regents* policy does not make passing the test a condition 
for transfer,' Some relevant studies on the pe3?fomance of transfer students 
compared with native students include Hills ,(1965'* ^ Panos et al. (I968), 
Walker (l969', Buckley (l970)^ and Melnick et al, (1970)- 

r;:lnce the implementatiori of the Regents* Test^ experimental and research 
activities; have dealt v;ith many aspects of the test. Much of this research 
has been concerned v^xth tho ^gSey since it largely accounts for failure, on the 
loUil eXfiiniaation. VJells (1973) examined how well essay performance could be 
predlc'-ed using reading and vrrHing objective tests and two different pre- 
diction models. Kavan (l973) mede e validity check of the procedure used to 
eval'i^ite the o.'^Gay and found that while the scores from the analytic evaluation 
vrere romev/ii-i t: lovrer than those ^rom the holistic evaluation, the results estab- 
lished tho 3ame fov^r ranks of e^say quality. Thompson and Rentz (cited in 
French, lO?'-' addressed the question of reliability of each rater using an 
accuracy percenlafj^e, defined qs the perce^^t of essays on which at least one 
other rater agreed vith the sco:re assigned. They found that during six admin- 
istrations of the Regents' Test^ there v^^s perfect rater agreement in 30-9 
percent of the case:?:, pa^^tial agreement in 6O-S percent of the cases, and 
total dina.-^reement in ''.9 •Pet*c<2t'.t of th4 cases. The work of French (197^) 
reported that "a small but sta^^istically significant degree of relationship 
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v^e;:; lonad ]>Q\.vreen i.lo..;raphlcaI factors, and essay score, and beti^een subgroup 
::i.-T;.:)er:-ni-p :-^''ossh:: ricore" ',p- 2^)^ Ifovrever, she concluded that "it is not 
v)o:5:.'i to idorifif;/, v/ltri any decree of CM:?rtainty5 .sunci'o^"^P- o^' .student:: vrho 
vrould IQ likely to*e>:p'erleace difficulty with va'iting at the college level" (p. 2k). 

■ \ Litokoi^ ' L':)7h) i:we3tiga.ted •itein'-blas in the Regents' reading comprehensive 
testinr. 1 ii::tr-Jiaent for homogeneous groups of institutions and concluded that 
^>9sed on fjverage item difficulty, the LSE [Regents' Test] vra.s differentially 
dlfficul'' for the four groups of institutions studied. The Universities, the 
Ceiiior 'olle^^es, the Junior Colleges, and then the plack^ £:o'lleges found the 
tec^t pro,^a-e^. lively more difficult" (p. 83). 

' Case S t udies 

vniz section of the paper presents the findings of two studies, one 
condu^'ted in 1972 by Plickman and the other in 1975 'oy Prather and Smith. 
';^oth of t:jec:e efforts sought to measure relationships betvreen the Regents' 
Tor>t- and exor-'enous and endogenous factors. Exogenous factors include such 
variabi.es .^cr3demic and family background, race, sex, and cognitive skills, 
w>::ie encio--:;e.:ious factors include those acquired in the student's higher educa- 
■ 1 1 0 n e >rpe J o r iC e . 

-r-j-,.;. X972 study population vras a university, two senior colleges and two 
.lurvior colle,:es. The college variables included HSA, SAT-V, SAT-M, CPA and 
grades in core curriculam courses; the biographical variables consisted of sex, 
race, &ge, rrtarital status, transfer status, and educational- background of parents. 
The princip^il factors influencing student performance were sex and minority 
sr.atus, indicating that females and non-minorities perform better on the test 
after controlling for the ability level of the study population. Surprisingly, 
grades in English composition v/ere not found to be correlated to performance 
on the n,est. It was concluded that school type was not a factor in performance 
on the T^egents' Test. g 
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[n 1975 a follow-up study was undertaken, with the population limited 
to the university. Although a number of procedural and policy changes had 
transpired during the intervening years, a comparison in Table 1 shows very 
Ijttle difference between the two studies. 

Insert Table 1 about here 

Analysis Procedure 
The least squares analysis of the test scores was perfomed in the 1975 
Gtudy uzinr, ^ stepv;ise procedure waich is a mathematical algorithm ranking 
the reiiTe::::.oxs according to how much of the variance in the regressand is 
accounted for v;hen controlling for the other variables previously entered into 
the analysis. This technique V7a.s used to locate those variables which had 
the nT.ron-.^e3L empirical association with the regressand. To aid in interpreting 
the re(jres:;iou analysis, the regression coefficient is given along with its 
standard error. The standardized regression coefficient ( 3 ) is included so 
that relatire impact of that regressor can be readily noted. The simple bi- 
v&ri?j^e correlation Letv;een each regressor and the regressand is also supplied. 
Uric do-ta prol:lem encountered in the original report (1975) wb.s the large amounts 
of in-l::sirir; data for certain key variables such as SAT's, GPA's, etc. To permit 
indu/rlon of trier^e vari^^bloo the mean value wa,s subst. :ted for missing values. 
A re-analyr:' G of the data \ra3 performed incorporating a procedure recommended 
by ':ohen ^1063\ This method allows for an objective measure of the impact of 
the missinr;; data. 

■■'ho d?-:sfi base v;as a weighted sample of those taking the test during. Fall 
197^^ and VMnter 1975, quarters. It represented the total- of those students 
who. failed or v;ho had previously failed and were repeating the test, and a 
3^1 percent sample of those v/ho passed the first f^time. The unweighted sample 1^ 



was 1011 while the total population equaled I9IO. (The slight variations from 
Iho ;:!.uri.7 popul&tlon riuiaocr and those shown on the subsequent tables for the 
woi.":hi.f'd . ?•] hvo due t.o rounding errors in the analysis). 



Results 



The first test score analyzed was with the regressand of the reading scores- 
The analysis Is given in T?jt^le 2 and the multiple correlation squared was -530- 
The firfit, repressors entered into the analysis were the SAT- Verbal test score and 
the cumulative nPA obtained at the university followed by non-minority status. 
The implication of these coefficients was that, all other regressors remaining 
unchariced, a verbal score of 60O would mean ih points on the reading test over 
a verhhl score of 300; that a 3-5 GPA was five points over a CPA of! 2.0; and 
thAdt non-minorities scored 6 points higher when compared to minorities of 
similar charflcteristics. Of the strongest endogenous regressors, being an 
En?,lish major added 3.8 points, vrhile being^ a business major subtracted one 
point. Having taken English composition after 1971— at this university or other 
institutions--shov;ed a negative impact on the reading score of about two points. 
The other endogenous variables showed little systematic impact on the reading 
score. 

Insert Table 2 about here 



'rhe analysis vnth the essay score as the regressand is presented in 

Table 3. The multiple correlation squared (R^^^ was .19k and the ,'itandard 

error of estimate (SEE) was .53^ relative to the scoring system of 1, 2, 

3 or k. .Similar to the reading test analysis, among the first variables 

entered were cumulative GPA (at this university), SAT-Verbal, and Freshman 

GPA. Being female and non-minority was found to have positive influence on 

the essay score; being a male minority and taking English composition since 

1972 to have a .negative impact; and being a social science major to be a positive 

O 

coefficient. ^ 
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Insert Table 3 about here 

The h:\bLycn.s of success or failure on the total test is given in Table k. 
'•'he W"^ v/as found to be .155 and a SEE was shovm to be .390 on the scale of 
one for h vbss and zero for a fail. The weak and the large SEE made it 
difficult, for the equation to have practical import. It was illustrative to 
interprel the coefficients as indicating an increase or decrease in the proba- 
niHt.r of passing the total test. For instance, a student with a 600 on the 
SAT-Verbal had a 15 percent higher chance of passing than with an SAT-Verbal 
of 300; 0 student with a 3.0 CPA had a 5.5 percent higher probability than 
the :->i>udent vn.th a 2.0 '."^PA; fema.le and non-minority status students had a ik 
percent Lv\r,her chance; male and minority status students had a 13-5 percent 
decreased chance of passing; and students having had English composition 
since 1972 had a decreased probability of passing by about seven percent. 

Insert Table k about here 



Predictability of Student Performance 
''he v/eak R^'s were further researched using a variant of least squares — 
muH'.iple discriminant anal.v'sis which is a technique of statistically distnn- 
£?:uiGliing jjinong two or more groups. For one analysis the grouping characteristic 
was the essay score and for the other the pass-fail score. The regressors 
used In T^jbles 2 through k vrere the discriminant variables which were used 
to ineor-ure how the grouping differed. The purpose of using the discriminant 
analycis was to determine hovr well the essay scores category could be predicted 
and wiiether the same could be applied to the pass or fail grouping. Table 5 
contains the summary of how well the essay score could be predicted using 
liiese criteria.. The predictions were quite weak, with 35 percent of the. 
failure group beinr- predicted to pass. Of those who actually passed, 27 
percent were predicted to fail. Note that five of the failure students 
would have been predicted to score four on the essay. 



Insert Table 5 about here 

TiiC &\:.\r:Timi[\hni: ^jfA-ilyzic in Table 6 is of the total test result. The 
arialyrris •indicated Uml 71 percent of those who passed would have been pre- 
dicted to pass, and 68 percenl: of those who actually failed were predicted to 
fail. Since the techniques are functionally equivalent, the strongest dis- 
crirn:! nrj tiri/7; variable for both the essay and the final results were the same 
as those found in the re/;-ression. 

insert Table 6 about here 

The low level of pred'.ictnon found in this study is due to a number of 
possibilities, the first of which is the possible presence of measurement error 
in the repressor. But also there exist questions relative to the reliability 
of the essay (French, 197-1 and its external validity. Unanswered questions 
affecting; the predictability of the essay score are those of student attitudes 
toward the tei^i and the effect of remedial training. 

Summary and Implications 
ihJl^ paper ha.^ attempted to address the underlying factors influencing 
student perforrna nee on a system-wide language skills examination. The principal 
factors influencing language skills of college students, as measured by the 
Regents' Test, appear to be exogenous or external to an institution. One is 
left to v/onder if what is taught is being tested and if what is tested is being 
taught. It can only be conjectured as. to whether or not the massive testing 
proi/rara i.s doing more than just focusing attention on the problem. The establish 
ment of remedial programs at each institution is a further attempt by the Regents 
to find a solution. But the problem remains: these writing skills, somewhat 
mysteriously acquired, appear elusive to measure. Test constructers and re- 
searchers . have a continuing responsibility to apprise policy-makers of the 
limitations and implications of measurement tools. 
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Table 1 



Comparative Data on Regents' Test 
1972 and 1975 







ESSAY 




R 


FADING 










1975 






1975 


Variables 


1972 


Study 


Study 


1972 


Study 


Study 




Total 


Univ 




Total 


Univ 






Sample 


Sub-Sampl^:- 


Univ 


SaOTle 


Sub- Sample 


Univ 


Female 


.15 


.18 


.12 


.03 


.13 


.03 


Non-Minority 


.15 


-.11 


.17 


.48 


.32 


..42 


Veteran 


-.09 


-.06 


-.03 


.05 


.04 


-.01 


Native Student 


.04 


.03 


.03 


.15 


.01 


.005 


HS GPA 


.23 


.18 


.11 


.21 


.17 


.09 


SAT - Verbal 


.37 


.32 


.29 


.75 


.70 


.59 


SAT - Math 


.21 


Vl7 


.24 


.57 


.39 


.37 


English Comp. GPA 


.20 


.30 


.13 


.21 


.39 


.17 


Freshman GPA 


.21 


.20 


.23 


.28 


.42 


.27 


Cumulative GPA 


.25 


.26 


.30 


.34 


.44 


.47 
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Table 2 

Regression Analysis of Regent's Test 
Component: Reading Score 



Standard 





Regressor 


Error of 




Simple 


Repressors 


Estimators 


Estimators 


3 


r 


SAT- Verbal 




.002 


.407 


• 586 


GPA-Univ 


3.247 


.262 


.254 


.468 


Non-Minority 


5.903 


.703 


.235 


.421 


Entered Higher Educ After 1971 


• -C590 


.452 


-.031 


- .094 


Other Eng. Indicator 


.308 


.125 


.046 


.210 


English Major 


3.764 


1.066 


.060 


. 139 


Business Major 


-.722 


.476 


-.035 


-.111 


Eng. Comp. After 1971-Other 


-2.344 


. 501 


-.111 


TOO 

- . 130 


Mother's Educ 


.602 


.297 


.038 


.142 


Eng. Comp. After 1971-Univ 


-1.522 


.482 


-.076 


- .003 


Eng. Comp. GPA 


.590 


.163 


.079 


.165 


Para-Medical Major 


-1.749 


. 597 


-.059 


.002 


Science Major 


-.527 


.165 


-.071 


.168 


Freshman GPA 


.713 


.237 


.073 


.272 


Education Major 


-1.073 


.567 


-.037 


-.092 


Senior Col. Transfer 


1.070 


.767 


.046 


-.113 


Business Indicator 


-.247 


.125 


-.038 


-.019 


Missing Data: Year Grad H.S. 


3.163 


1.389 


.051 


.017 


Missing Data: SAT- Verbal 


-.929 


.416 


-.046 


-.081 


Univ Level Transfer 


2.453 


.753 


.110 


.181 


Female 


1.262 


.797 


.068 


o o 


H.S. GPA 


. -L.083 


.449 


-.064 


.087 


Missing Data: H.S. GPA 


-1.269 


.596 


-.066 


-.021 


Junior Col. Transfer 


1.539 


.873 


.076 


- .072 


Transfer GPA Indicator 


-.408 


.213 


-.059 


- .009 


Humanities Indicator 


-.176 


.115 


-.028 


.128 


Missing Data : Father *s Educ 


-.624 


.522 


- .025 


- .113 


Year Grad H.S. 


-.129 


.079 


- .078 


- . U /I 


Year of Birth 


.091 


.076 


.058 


CO 

— . uoy 


Non-System Community Col. 


.574 


. 612 




oil o 


Social Science Indicator 


.554 


. 531 


.021 


A O C 


Hours Transferred 


.004 


.005 


.021 




Female-Non-Minority 


-.694 


. 838 


- .037 




Father's Educ 


.189 


• 251 


.014 


.169 


SAT- Math 


- .002 






'^71 

. O / J. 


HumanitTp*^ Indicator 


.316 


.547 


.011 


.070 


Missing Data: GPA Univ 


-.464 


.717 


-.011 


-.049 


Missing Data: Year of Birth 


1.026 


1.880 


.012 


-.011 


Non- Repeat 


.284 


.533 


.009 


• 125 


H.S. Located in County A 


.181 


o o 


OOP 

. uu o 


— O^R 


Full- Time Employed 


. J-vJ 3 


.340 


-.009 


.007 


Veteran 


.209 


.531 


.008 


-.014 


Social Science Indicator 


-.025 


.170 


-.003 


.252 


Missing Data: Mother's Educ 


.079 


.587 


.003 


-.103 


Cor."' tan t 


38.479 








r2 


.530 








standard Error of Estimate 


6.443 








Weighted N 


1916 
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Table 3 

Regression Analysis of Regent's Test 

Component : Essay 
" (Pass=2 5 3 or 4; Fail=0) 







Standard 








Regressor 


Error or 


P 


bimpxe 


Regress ors 


Estimators 


Estimators 


r 


GPA-Univ 


.127 


.022 


.156 


.299" 


SAT-Verbal 


.0006 


.0002 


.090 


.289 


Female-Non-Minority 


.064 


.047 


.054 


1 TT 


Freshman GPA 


.065 


.020 


.105 , 




Non-Repeat 


.149 


.044 


.073 


TOO 


Eng. Comp. After 1971-Other 


-.074 


;041 


- .056 


A O C 

- .085 


Social Science Major 


.123 


.041 


.072 


A C 

• .055 


Other Eng. Indicator 


.027 


.010 


.063 


ICO 

.Xbz 


SAT-Math 


.0006 


. 0002 


ACQ 




Male- Minority 


-.158 . 


.066 


-.064 


n 1 1 A 

- .X40 


Social Science Indicator 


-•032 


.014 


-.063 


. XH/ 


Year of Birth 


-.013 


.006 


- .Xzb 


A 

— . UOZ 


Missing Data: GPA Univ 


.106 


.059 


f\\\f\ 


— . uxx 


Missing Data: SAT Math 


.-.071 


.319 


A C C 

- .000 


— . UOD 


Missing DatarH.S. GPA 


.145 


.049 






H.S, GPA 


.068 


.037 . 




. XUD 


Mother's Educ 


.048 


.025 


A li O 

.U4o 


A7 ^ 


H.S. Located in County A 


-.089 


.035 


A C O 


ARK 


Transfer GPA Indicator 


-.010 


.018 


AOI 1 


— AIR 

— . UXD 


Business Indicator 


.026 


. 010 


ACO 


. uou 


Business Major 


-.056 


.036 


A 1 1 O 


1 All 

— . XUH 


Eng. Comp. After 1971-GSU 


-.073 


.040 


ACT 

- . 057 


AO A 


Hours Transferred 


-.0008 


.0004 




AAA 


Transferred from Univ. Level 


.043 


.040 


.030 


1 AO 

• 102 


Humanities Indicator 


.010 


.010 


.025 


.119 


H.S. Located in County B 


-.036 


.034 


-.027 


.004 ^ 


Eng. Indicator 


.013 


.014 


.027 


TOO 


Year Grad. from H.S. 


. .008 


.007 


AT A 

.079 


ACT 

— . UoX 


Missing Data: Year Grad. H.S. 


-.142 


.115 


-.036 


AO li 

- . 024 


Native Student 


.054 


.063 


.041 


' AQ 1 

« UoX 


Missing Data : Father 's Educ 


.022 


.043 


A n 1 1 

. 014 


AQ 

— . UOO 


Male- Non- Minority 


-.040 


. 050 


A^Ll 
— . UOH 


— . UOV/ 


Education Major 


- .021 


All Q 




- 098 


Father's Educ 


.013 


.021 


.016 


.073 


Science Indicator 


-.008 


.014 


-.016 


.153 


Veteran 


.020 


.044 


A n o 
. 0X2 


AQ1 

— • UoX 


Missing Data: Year Birth 


.056 


.155 


.011 


AOQ 


Year Entered Higher Educ 


-.012 


.037 


-.010 


-.025 


Humanities Indicator 


.012 


.042 


.007 


.030 


Missing Data : Mother 's Educ 


.008 


.048 


.004 


-.030 


Junior Coll, Transfer 


-.006 


.039 


-.005 


-.086 


Missing Data: SAT- Verbal 


-.032 


.319 


-.025 


-.035 


Constant 


.326 








. r2 


.194 








Standard Error of Estimate 


.534 









Weighted N 1915 



ERIC 
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Table 4 

Regression Analysis ^of Regent's Test 
Component : Results 
(Pass=l, Fail=0) 



Regressors 

SAT-Verbal 
GPA-Univ 

Female-Non- Minority 
Missing Data: SAT-Math 
SAT- Math 
Male- Minority 
Social Science Major 
Freshman GPA 
Non- Repeat 

Eng. Comp. After 1971-Other 
Eng. Comp. After 1971-Univ 
Missing Data- Year Birth 
Hours Transferred to Univ • 
Missing Data-H.S. GPA 
H.S-. Located County A 
Other Eng. Indicator 
Missing Data- Father 's Educ 
Veteran 
Mother's Educ 
Business Indicator 
Native Student 
Transfer GPA Indicator 
Missing Data-Year Grad H.S, 
Business Major 
Para-Medical Major 
Missing Data-GPA 
Eng. Comp. GPA 
Social Science Indicator 
H.3. GPA 
Male 

Science Indicator 
H.S. Located- County B 
Missing Data- SAT Verbal 
Missing Data- Mother ^ s Educ 
Science Major 
Junior Col. Transfer 
Year of Birth 
Year Graduated H.S. 
Humanities Major 
Education Major 
Full-Time- Employed 
Father's Educ 
Non- System Community Col. 
Humanities Indicator 
Senior Col. Transfer 
Constant 



Standard Error of Estimate 
Weighted N 





Standard 






Regressor 


Error of 




Simple- 


Estimators 


Estimators 


. B 


r 


.0005 


.0002 


.098 


.263 


.055 


.016 


.096 


.229 


.136 


.035 


.159 


.189 


-.218 


.234 


-.238 


-.082 


.0004 


.0002 


.073 


.214 


-.135 


.042 


-.077 


-.152 


.079 


.034 


.065 


.052 


.028 


.014 


.064 


.176 


.069 


.032 


.048 


.112 


-.069 


.026 


-.072 


-.052 


-.082 


.029 


-.091 


;oi3 


-.082 


.114 


-.022 


-.074 


-.0009 


.0003 


-.093 


-.028 


.085 


.036 


.098 


-.018 


-.057. 


.026 


-.056 


-.059 


.007 


.008 


.024 


.116 


.064 


.031 


.058 


-.034 


.040 


.032 


.033 


-.023 


.031 


.018 


.044 


.069 


.011 


.008 


.036 


.009 


.074 


.044 


.079 


.032 


.020 


.013 


.064 


.009 


-.170 


.084 


-.061 


-.065 


-.014 


.031 


-.015 


-.076 


-.050 


.041 


-.037 


.013 


.035 


.043 


.019 


-.004 


.015 


.010 


.045 


.106 


-.010 


.010 


-.028 


.125 


.032 


.027 


.042 


.094 


-.03? 


.037 


-.038 


.106 




.010 


-.017 


.123 


-.Olx 


.026 


-.011 


.037 


.137 


.233 


.150 


-.080 


- .020 


.036 


-.015 


-.056 


.031 


.037 


.029 


.024 


- .006 


.038 


-.007 


-.044 


-.009 


.005 


-.121 


-.011 


.009 


.005 


-.121 


-.006 


.025 


.035 


. U^U 


. uz o 


.024 


.036 


.018 


-.003 


nno 
. uu^ 


091 


.010 


.004 


.006 


.016 


.010 


.072 


-.009 


.038 


-.009 


-.028 


.008 


.007 


.003 


.074 


-.003 


.029 


-.003 


-.041 


-.334 








.155 








.390 









1916 



16 
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Table 5 



Summary of Multiple Discriminant Analysis 
Based Upon Results of the Essay 



Predicted 



Actual Scores 




Scores on Essay 




Total 




1 


2 


3 • 


^■ 




1 


273 


103 


38 


5 


419 


2 


387 




353 


17 


1261 


3 


18 


^9 


151 


6 


224 










9 


9 


TOTAL 


678 


656 


5i^2 


37 


1913 



17 



-15- 



Table 6 

Summary of Multiple Discriminant Analysis 
Based Upon Results of Total Test 

Actual Performa nce Predicted Performance 

Fail Pass 

296 138 

42b . 1053 

TOTAL 722 1191 



Fail 

Pass 
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